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1. Introduction 



Abstract. In this paper, the weak convergence of impulsive recurrent process with Markov switching 
in the scheme of Levy approximation is proved. For the relative compactness, a method proposed by 
R. Liptser for semimartingales is used with a modification, where we apply a solution of a singular 
' perturbation problem instead of an ergodic theorem. 

CM : 

> : 
o ■ 

Levy approximation is still an active area of research in several theoretical and applied directions. Since 
~^evy processes are now standard, Levy approximation is quite useful for analyzing complex systems (see, 
p— eig. [H[8]). Moreover they are involved in many applications, e.g., risk theory, finance, queueing, physics, 

etc. For a background on Levy process see, e.g. [H[8l[3j. 
Oh In particular in [5] it has been studied the following impulsive process as partial sums in a series scheme 

£ : 

the random variables a e k (x), k > 1 are supposed to be independent and perturbed by the jump Markov 
^ process x(t),t > 0. 

j> . We propose to study generalization of the problem |T]) : 
OO I u(t) 

i2: e(t) = eo+J2* s M-i,Xk-i), *>o. (2) 

fc =i 

^lere the random variables a%(u, x), k > 1 depend on the process 
' We propose to study convergence of ([2]) using a combination of two methods. The method proposed by 
O"^- Liptser in [6] , based on semimartingales theory, is combined with a solution of singular perturbation 
Cproblem instead of ergodic theorem. So, the method includes two steps. 

| In the first step we prove the relative compactness of the semimartingales representation of the family 
e > 0, by proving the following two facts as proposed in Liptser [7]: 



$_] ■ lim sup P{sup > c} = 0, 

known as the compact containment condition, and 

E|fw-r(s)i 2 <k\t- s \, 

for some positive constant k. 

In the second step we prove convergence of two components of Markov process £ £ (i), aef := ee(t/e 2 ) by 
using singular perturbation technique as presented in [5|. 

Finally, we apply Theorem 6.3 from [5]. 

The paper is organized as follows. In Section 2 we present the time-scaled impulsive process © and 
the switching Markov process. In the same section we present the main results of Levy approximation. 
In Section 3 we present the proof of the theorem. 
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2. Main results 

Let us consider the space R d endowed with a norm |-| (d > 1), and (E, £), a standard phase space, (i.e., 
E is a Polish space and £ its Borel er-algebra). For a vector v G M. d and a matrix c G M. dxd , i>* and c* 
denote their transpose respectively. Let C3(R d ) be a measure-determining class of real- valued bounded 
functions, such that g{u)/\u\ 2 -> 0, as |tt| -> for 5 G C^R 6 *) (see HO). 

We introduce a family of random sequences a|(a;),A; = 1,2,..., a; G E, where E is a non-empty set, 
indexed by the small parameter e > 0. For any e > 0, and any sequence z k ,k > 0, of elements of 
R d x E, the random variables at(zk-i),k > 1 are supposed to be independent. Let us denote by G e ux 
the distribution function of a £ k (x), that is, 

G e U:X {dv) := P{a%(u,x) G dv),k >0,£>0 1 ie£,«el i 

The switching Markov process x(t),t > on the standard phase space (E,£), is defined by the 
generator 

Q<p(x) = q(x) f P(x, dy)[tp(y) - tp(x)], (3) 
Je 

where q(x), x G E, is the intensity of jumps function of x(t), t > 0, and P(x, dy) the transition kernel of 
the embedded Markov chain x n ,n > 0, defined by x n = x(T n ),n > 0, with = to < n < ... < r„ < ... 
the jump times of x(t),t > 0. Corresponding counting processes of jumps v{t) := max{fc > : < t}. 
We make natural assumptions for the counting process v(t), namely: 

[ B[ip(s)dv(s)] < h [ E(<p(s))ds (4) 
Jo Jo 

for any nonnegative, increasing tp(s) and l\ > 0. 

Now we define a family of jump Markov processes x e (t) := x(t/e 2 ),t > 0, with embedded Markov 
renewal process x|,r|,fc > 0, and counting processes of jumps v £ (t) — v(t/e 2 ),t > 0. Thus, times 
r|, k > 0, are jump times, x| := x £ (t^), and v £ (t) := max{fc > : r| < t}. 

The impulsive processes ^ s (t),t > 0,e > on R d in the series scheme with small series parameter 
e — > 0, (e > 0) are defined by the sum ([5J Section 9.2.1]) 

e(t) = e + E *>o- (5) 

k=l 

Here 

n 

^ := £(£ 2 r„) - ^ + E^^-i'^-i)' 
fe=l 

It is worth noticing that the coupled process £ e (i), x e (t), t > 0, is a Markov additive process (see, e.g., 
[5J Section 2.5]). 

The Levy approximation of Markov impulsive process ^ is considered under the following conditions. 

CI:: The Markov process x(t),t > is uniformly ergodic with tt(B),B G £ as stationary distribu- 
tion. 

C2:: Levy approximation. The family of impulsive processes £, E (t),t > satisfies the Levy approxi- 
mation conditions [5J Section 7.2.3]. 
LI:: Initial value condition 

supE^I < C < 00. 
L2:: Approximation of the mean values: 

a e (u\x)— I vG £ lx (dv) = eai(u; x) + e 2 [a(u; x) + 8 e a {u\ x)], 
Jm d 

and 

c £ (u]x)= / vv*G £ ux (dv) = e 2 [c(u;x) +6 £ (u;x)}, 
Jm d 

where functions a\,a and c are bounded. 
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L3:: Poisson approximation condition for intensity kernel (see [?]) 
Gl{u-x)= [ g(v)Gl x (dv)=e 2 [G g (u;x) + e s g (u;x)} 

for all g G C3(M d ), and the kernel G g (u;x) is bounded for all g G C3(M. d ), that is, 
\G g (u; x)\ < G g (a constant depending on g). 

Here 

G g (u;x)= [ g(v)G UtX (dv), g G C 3 (R d ). 
Js. d 

The above negligible terms 6%, d e c) 9 e g satisfy the condition 

sup \8 e (u; x)\ — » 0, e — > 0. 

L4:: Balance condition. 

p(dx)ai(u; x) = 0. 



(6) 



In addition the following conditions are used: 
C3:: Uniform square-integrability: 



lim sup / vv*G u x (dv) = 0, 
: — 00 zee J\v\>c 



'x£EJ\v\> 

where the kernel G ux (dv) is defined on the measure determining class C3(K d ) by the relation 
©■ 

C4:: Linear growth: there exists a positive constant L such that 

\a(u;x)\<L(l + \u\), and \c(u; x)\ < L(l + \u\ 2 ), 

and for any real-valued non-negative function /(x),x G M. d , such that / R d\{ }(! f( x )) \ x \ 2 ^ x ^ 
oo, we have 

\G u , x (v)\ <Lf(v)(l + \u\). 



The main result of our work is the following. 
THEOREM 1. Under conditions CI — C4 the weak convergence 

r(t)=>€°(t), £-0 

takes place. 

The limit process £°(t),t > is a Levy process defined by the generator L as follows 



Lcp(u) = (a(u) - o„(u)y (u) + -a 2 (u)<p"(u) + X(u) / [<p(u + v) - <p(u)]G° u (dv), (7) 
tujf/i cr 2 (w) > 0, where: 

a(u) = q I p(dx)a(u;x),a {u) = / vG u (dv),G u (dv) = q I p(dx)G u , x (dv), 



a (u) = 2 / 7r(<ix)[ai (u; x)i?oa*(u; x)], ai(u; x) := g(x) / P(x,dy)ai(u;x) 
J e J E 

\{u) = qG u (R d ), G° u (dv) = G u (dv)/G u (R d ). 
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3. Proof of Theorem 1 

The proof of Theorem 1 is based on the semimartingale representation of the impulsive process ([5]). 

We split the proof of Theorem 1 in the following two steps. 
Step 1. In this step we establish the relative compactness of the family of processes £ e (i), t > 0, e > by 
using the approach developed in [6] . Let us remind that the space of all probability measures defined on 
the standard space (E, £) is also a Polish space; so the relative compactness and tightness are equivalent. 

First we need the following lemma. 

LEMMA 1. Under assumption C4 there exists a constant k > 0, independent of e and dependent on 
T , such that 

Esup |£ e (i)| 2 < k T . 

t<T 

COROLLARY 1. Under assumption C4, the following compact containment condition (CCC) holds: 

lim sup P{sup \£ E (t)\ > c} = 0. 

c ^°°£<eo t<T 

Proof. The proof of this corollary follows from Kolmogorov's inequality. 

□ 



Proof of Lemma 1: (following 6 ). The impulsive process ^ has the following semimartingale represen- 
tation 

?(t)=u + Bt + M$, (8) 
where u = i?f is the predictable drift 

B s t = ]T a^a. 1 ,xU 1 )=Al(t)+A E (t)+ei(t) : 

k=l 

where 

u{t/e 2 ) v{t/e 2 ) 

A\{t):=e «i(£fc-i,4-iM e (*) ==e 2 E a (8-i.*k-i)- 

fe=i fe=i 

v(t/e 2 ) u(t/e 2 ) 

( M c) t = e 2 J2 <?k-ii*l-i)+z 2 E / vv*G^ k _ l ,dv;x%_ 1 )+ei{t), (9) 
and for every finite T > 

sup \e £ (t)\ -> o,e -> o. 

0<«<T 

To verify compactness of the process £ £ (i) we split it at two parts. 
The first part of order e 

u(t/e 2 ) 

A\(t)=e 

fc=l 

can be characterized by the martingale 

Wt = V e {A\{t)) + (p E (Al(0)) - / LV(^! (s))ds. 

Jo 

Thus (see, for example Theorem 1.2 in (5j), it has quadratic characteristic 

< W >t= I [L E (^(Al(s))) 2 - 2^{A\{s)W^{A\{s))\ ds. 
Jo 

Applying the operator L e = e _2 Q + £ Ai to test-function (p £ = <p + eipi (here Ai(u;x)(p(v) = 
ai(u;x)ip'(v)) we obtain the integrand of the view 

Qipl - 2<piQ(p\. 

It is independent of e and limited. The boundedness of the quadratic characteristic provides juf is 
compact. Thus, ip(A\(t)) is compact too and bounded uniformly by e. 
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Now we should study the second part of order e 2 . 

For a process y(t),t > 0, let us define the process y^(t) = sup |y(s)|, then from {SJ we have 



s<t 

21 



((rW) t ) 2 <4[ U 2 + ((^(t))t) 2 + ((Mf)t) 
Now we may apply the result of Section 2.3 [5], namely 

"(*) r t 



L.-1 JO 



k=l 

Condition C4 implies that for sufficiently large e 

[tie 1 ft/e 2 

(A £ (t))t = e 2 / a{¥{s),x s {s))dv{s)<Le 2 (1 + (f 
Jo Jo 



Now, by Doob's inequality (see, e.g., [3 Theorem 1.9.2]), 

E((Af t £ ) t ) 2 < 4|E(M £ ) t | 

© and condition C4 we obtain 



-- I' 1 " c(e(s);x"( S ))+e 2 f' £ f vv*G(e{s),dv;x s s )dv(s) 

Jo il d \{0} 

rt/e- 



< 



2L{l + ri )e 2 f [l + ((f( S ))t) 2 ]^( S ), 
Jo 



where n = / Rd \ {0} M 2 /(x)da;. 

Inequalities (fT0| - (fT2|) . condition and Cauchy-Bunyakovsky-Schwarz inequality, ([/ * (p(s)ds] 
t Jo ( P 2 ( s ) ds )> impiy 

E((f(t)) t ) 2 <fc 1 +fc 2£ 2 E[((f ( S ))t) 2 ^)] <fci + fc 2 /i£ 2 I''' E((f ( S ))t) 2 d s = 

Jo Jo 

fei + fcil / E((r(s)) t ) 2 rfs, 
Jo 

where fci, ki and /i are positive constants independent of s. 
By Gronwall inequality (see, e.g., [H p. 498]), we obtain 

E((£ E (t))t) 2 < k ie xp{k 2 ht). 

Thus, both parts of £ £ (i) are compact and bounded, so 



Esup \C(t)\ < fc T- 



Hence the lemma is proved. 



LEMMA 2. Under assumption C4 i/iere exists a constant k > 0, independent of e such that 

E\e(t)-e(s)\ 2 <k\t- s \. 

Proof. In the same manner with (fT0|) , we may write 

If W - r (s)| 2 < 2|B £ - Bl\ 2 + 2\MI - M!\ 2 . 

By using Doob's inequality, we obtain 

E|e*(i) - f (s)| 2 < 2E{|B £ - 5 e | 2 + 8 \{M e ) t - {M e ) s \}. 

Now (fT2j) and condition ([4]) and assumption C4 imply 

|£f - B;\ 2 + 8 |<M s > t - (M £ ) s | < fc 3 [l + ((f (T))t) 2 ]|t - s |, 

where &3 is a positive constant independent of e. 

From the last inequality and Lemma 1 the desired conclusion is obtained. 
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The conditions proved in Corollary 2 and Lemma 2 are necessary and sufficient for the compactness 
of the family of processes £, £ (t),t > 0,e > 0. 



Step 2. At the next step of proof we apply the problem of singular perturbation to the generator of the 
process £ e (t). To do this, we mention the following theorem. C^M^ x E) is the space of real- valued twice 
continuously differentiable functions on the first argument, defined on R d x E and vanishing at infinity, 
and C(R d x E) is the space of real-valued continuous bounded functions defined on R d x E. 

THEOREM 2. ([5, Theorem 6. 3] ) Let the following conditions hold for a family of Markov processes 
f(f),t>0,£>0: 

CD1:: There exists a family of test functions (p £ (u,x) in C$(R. d x E), such that 

lim (p e (u, x) = tp(u), 

e— >0 

uniformly on u, x. 
CD2:: The following convergence holds 

lim L £ ip £ (u, x) =li<p(u), 

uniformly on u,x. The family of functions Jj £ ip £ ,e > is uniformly bounded, and ~Ltp(u) and 
L £ tp £ belong to C(R d x E). 
CD3:: The quadratic characteristics of the martingales that characterize a coupled Markov process 
£, e {t), x £ (t), t > 0,e > have the representation {^ £ ) t = J^( £ ( s )ds, where the random functions 
C £ ,£ > 0, satisfy the condition 

sup E|C e (s)| < c < +oo. 

0<s<T 

CD4:: The convergence of the initial values holds and 

supE|C e (0)| < C < +oo. 

Then the weak convergence 

r(t)=>^), e^O, 

takes place. 

We consider the two component Markov process £ £ (t),x £ ,t > which can be characterized by the 
martingale 

l4 = <p(?(t) t a%)- /'lW (s),xt)ds, 



where its generator 1/ has the following representation Lemma 9.1 

L £ cp(u,x)=e- 2 q(x) [ P(x,dy) [ G £ u Jdz)cp(u + z,y)- (13) 

ip{u,x)} . 

By analogy with [51 Lemma 9.2] we may prove the following result: 
LEMMA 3. The main part in the asymptotic representation of the generator is as follows 
L £ (p(u, v, x) = e~ 2 Qip(-, ■, x) + e~ 1 Q Q a 1 (u; x)<p' u (u, •, •) + Qo[a(u; x) - a Q (u; x)]ip' u (u, ■, ■) + 

Q G UiX (p(u, ; •) 

where: 

Qo<p(x) := q(x) / P(x, dy)<p(y), G UiX tp(u) := / [<p(u + v) - ip(u)]G u , x (dv), 



a (u;x) = / vG UtX (dv). 



LEVY APPROXIMATION OF IMPULSIVE RECURRENT PROCESS WITH MARKOV SWITCHING. 



7 



Proof of this Lemma is analogical to the proof of [5, Lemma 9.2]. 

The solution of the singular perturbation problem at the test functions (p E (u, x) = ip(u) + eipi(u, x) + 
e 2 if2(u, x) in the form ~L £ tp £ — Liip + 6 e tp can be found in the same manner with Lemma 9.3 in [5]. That 
is 

L = n[Q (A(x) + G„, x ) + QoAi^fioQoAi^jn, (14) 

where 

A(x)ip(u) :— [a(u;x) — ao{u;x)]ip'(u),Ai(x)ip(u) := a\(u\x)ip (u). 
Simple calculations give us from (fl4|) . 
Now Theorem 2 can be applied. 

We see from (fT3"]l and (fT4")l that the solution of singular perturbation problem for L e (p e (u, v; x) satisfies 
the conditions CD1, CD2. Condition CD3 of this theorem implies that the quadratic characteristics 
of the martingale, corresponding to a coupled Markov process, is relatively compact. The same result 
follows from the CCC (see Corollary 2 and Lemma 2) by [I]. Thus, the condition CD3 follows from the 
Corollary 2 and Lemma 2. As soon as £ e (0) = £°(0) we see that the condition CD4 is also satisfied. 
Thus, all the conditions of above Theorem 2 are satisfied, so the weak convergence £ £ (t) — > £°(t) takes 
place. 



Theorem 1 is proved. 

□ 
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